Good News for Otakus! VR Role-Playing AI is Here, NTU's New Breakthrough in 'Creating Characters' Can Sing, Dance, and Chat with You!

A research team at Nanyang Technological University in Singapore has recently unveiled an AI technology called SOLAMI, which can create lifelike 3D virtual characters that not only interact with you in real-time in the VR world but also understand your voice and movements, allowing for chatting, dancing, and even boxing! This is simply a blessing for gaming, virtual socializing, and singles alike! SOLAMI is an end-to-end social vision-language-action (VLA) modeling framework that leverages deep learning technology to translate user voice and movements into a form understandable by virtual characters.